previous post - move file from remote system to Hadoop HDFS cluster
command to move the file from Hadoop HDFS cluster to remote system.
In some case we would need to move the output of MapReduce file from Hadoop HDFS to non installed Hadoop system.
move file from Hadoop cluster to remote system ( Non Hadoop system )
bdalab@solai:/opt$ hadoop dfs -cat hdfs://NameNodeIP:9000/user/part-* | ssh userName@remoteSystemIP 'cat - > /home/hadoop/MRop'
here,
part-* -> is a file to be moved from HDFS
userName -> userName of remote system
remoteSystemIP -> IP address of remote system
No comments:
Post a Comment